Software Verification and Validation Laboratory: Automated Test Suite Generation for Time-Continuous Simulink Models
نویسندگان
چکیده
All engineering disciplines are founded and rely on models, although they may differ on purposes and usages of modeling. Interdisciplinary domains such as Cyber Physical Systems (CPSs) seek approaches that incorporate different modeling needs and usages. Specifically, the Simulink modeling platform greatly appeals to CPS engineers due to its seamless support for simulation and code generation. In this paper, we propose a test generation approach that is applicable to Simulink models built for both purposes of simulation and code generation. We define test inputs and outputs as signals that capture evolution of values over time. Our test generation approach is implemented as a meta-heuristic search algorithm and is guided to produce test outputs with diverse shapes according to our proposed notion of diversity. Our evaluation, performed on industrial and public domain models, demonstrates that: (1) In contrast to the existing tools for testing Simulink models that are only applicable to a subset of code generation models, our approach is applicable to both code generation and simulation Simulink models. (2) Our new notion of diversity for output signals outperforms random baseline testing and an existing notion of signal diversity in revealing faults in Simulink models. (3) The fault revealing ability of our test generation approach outperforms that of the Simulink Design Verifier, the only testing toolbox for Simulink.
منابع مشابه
Mutation-Based Test Case Generation for Simulink Models
The Matlab/Simulink language has become the standard formalism for modeling and implementing control software in areas like avionics, automotive, railway, and process automation. Such software is often safety critical, and bugs have potentially disastrous consequences for people and material involved. We define a verification methodology to assess the correctness of Simulink programs by means o...
متن کاملA search-based framework for automatic test-set generation for MATLAB/Simulink models
Modern testing requires faults to be discovered at the earliest possible stage, i.e. specification or architecture design stage rather than at the coding stage, because the cost of fixing an error increases with the time between its introduction and detection. Testing is required to exercise high-level models. Simulink is a software package for modelling, simulating, and analysing system-level ...
متن کاملGeneration of Branch Coverage Test Data for Simulink/Stateflow Models Using Crest Tool
Automated test suite generation is an optimization technique to reduce test effort and duration. Software Testing has traditionally been one of the main techniques contributing to high software quality and dependability. Testing performance consumes about 50% of software development resources, so any methods aiming at reducing softwaretesting costs are likely to reduce software development cost...
متن کاملMutation-based Test Data Generation for Simulink Models using Genetic Algorithm and Simulated Annealing
Software testing is costly, labor intensive, and time consuming. Modern testing requires faults to be discovered at the earliest possible stages to decrease the cost of fixing errors in software development process. Thus, high level models such as Simulink models have become the focus of much verification effort and research. Mutation testing is a powerful and effective testing technique in ter...
متن کاملUsing the Beopt Automated Residential Simulation Test Suite to Enable Comparative Analysis Between Energy Simulation Engines: Preprint
Verification and validation are crucial software quality control procedures to follow when developing and implementing models. This is particularly important because a variety of stakeholders rely on accurate predictions from building simulation programs. This study uses the BEopt Automated Residential Simulation Test Suite (BARTS) to facilitate comparison of two energy simulation engines acros...
متن کامل